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Overview 


•  Survey  background 

•  Survey  results 

•  Implications  and  way  ahead 
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Executive  Summary 


•  Heterogeneous  job  structure  with  one  cluster  and 

seven  independent  jobs  identified 

•  Technical  tasks  are  performed  throughout  all  skill 

levels 

•  Career  ladder  documents  supported  by 

survey  data 

•  Job  satisfaction  indicators  are  good 
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Work  Performed 


•  Emulates  the  role  of  a  hostile  intelligence  service  (HOIS) 
by  collecting,  analyzing,  and  processing  DoD 
telecommunications,  such  as:  telephone,  computer-to- 
computer,  facsimile,  radio,  and  wireless  transmissions 

•  Applies  analytical  processes  to  determine  critical 
information  potentially  compromised  and  exploited  by 
HOIS  threats 
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Identifies  adverse  operations  security  (OPSEC)  trends 
and  monitors  friendly  telecommunications  during 
peacetime  operations 
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Current  Training  Program 


•  AFSC-awarding  course 

-  316  TRS,  Goodfellow  AFB  TX 

-  X3ABR1N631-005,  Electronic  System  Security  Assessment 
Apprentice  Course,  40  days 

-  15  Semester  hours  for  CCAF 

-  Programmed  TPR  Programmed  Elimination  Rate 

FY04:  163  students  FY04:  2% 

FY05:  1 35  students  FY05:  2% 
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\J  Survey  Background 


•  Current  survey  developed  -  November  2003  - 
January  2004 

•  Goodfellow  AFB  TX  (Tech  School)  (3) 

•  Brooks  AFB  TX  (5) 

•  Lackland  AFB  TX  (6) 

•  Hickam  AFB  HI  (4) 

•  Camp  Smith  HI  (2) 

*  '  '  Occu  national  Measurement  Sauadron 


Scott  AFB  IL 


Occupational  Measurement  Squadron 
Occupational  Analysis  Products 


To  Run:  place  CD  in 
drive  for  autorun  or 
select  Index  from  file „ 


Contents; 
Occupational 
Survey  Report, 
Training  and 
Analysis  Extracts, 
and  OSR  Briefing, 


ELECTRONIC  SYSTEMS 
SECURITY  ASSESSMENT 
1N6X1 

November  2004 
(Approved  for  Public  Release; 
Distribution  Unlimited) 
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Survey  Background 


•  Survey  initiated  to  obtain  data  to: 


-  Evaluate  current  classification  and  training  documents 

-  Support  promotion  test  development 


•  Current  survey  data  collected  -  June  -  September 
2004 


•  Components  surveyed: 

-  Active  Duty:  3-,  5-,  7-  and  9-Skill  Levels 

-  Reserve:  3-,  5-,  7-  and  9-Skill  Levels 


UNCLASSIFIED 
Air  Force 

Occupational  Measurement  Squadron 
Occupational  Analysis  Products 


Contents; 
Occupational 
Survey  Report, 
Training  and 
Analysis  Extracts* 
and  QSR  Briefing, 


ELECTRONIC  SYSTEMS 
SECURITY  ASSESSMENT 
1N6X1 

November  2004 
(Approved  for  Public  Release; 
Distribution  Unlimited) 
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Survey  Sample  Characteristics 


Assigned* 

AD 

346 

AFRC 

57 

Total 

403 

Mailed  Out 

240 

44 

284 

Sample 

172 

12 

184 

Usable  Returns 

72% 

27% 

65% 

•  Average  time  in  career  field  for  AD:  5  yrs  9  mos 

•  Average  TAFMS  for  AD:  6  yrs  9  mos 

•  Percent  of  AD  in  first  enlistment:  51% 
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*  Assigned  as  of  Nov  04 


Paygrade  Characteristics 


Paygrade  Distribution 


Assigned* 

Sample 

E-1  -  E-2  - 

E-3 

12% 

28% 

4% 

28% 

E-4 

18% 

21% 

E-5 

20% 

23% 

E-6 

12% 

14% 

E-7 

7% 

7% 

E-8 

3% 

3% 

*  Assigned  as  of  Nov  04 
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Command  Representation 


Command  Assigned  %**  Sample  % 

AETC  3  3 

AIA  83  90 

AFRC  14  7 


**  Assigned  as  of  Nov  04 
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Job  Structure 


Sample  Size:  184 


Management  and 
Supervisory  IJ 

-  7% 


Information 
Warfare  (IW)  IJ 


Mission 
Management  IJ 

3% 


Junior  Analyst 
Cluster 
26% 


Not  Grouped 
8% 


Computer  Network  General 

Defense  IJ  Administration  IJ 


Training  IJ 
5% 


Senior  Analyst  IJ 


3% 


44% 
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Junior  Analyst  Cluster  (N=48) 


•  Analyze  telephone  communications 

•  Analyze  electronic  mail  (e-mail)  communications 

•  Identify  personal  privacy  information  (PPI) 

•  Research  open  source  information 

•  Perform  data  transfers 

•  Identify  intelligence  threats  and  vulnerabilities 

•  Identify  OPSEC  vulnerabilities 

•  Destroy  classified  materials 

•  Create  or  develop  sanitized  transcripts 

•  Conduct  on-the-job  training  (OJT) 


Monitoring  Analyst  Job 

OPSEC  Analyst  Job 

Supply  and  Equipment  Technician  Job 
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Independent  Jobs 


•  Senior  Analyst  IJ  (N=82) 

-  Analyze  e-mail  communications 

-  Analyze  telephone  communications 

-  Research  open  source  information 

-  Identify  personal  privacy  information  (PPI) 

•  Training  IJ  (N=9) 

-  Evaluate  progress  of  Trainees 

-  Brief  personnel  concerning  training  programs  or  matters 

-  Counsel  trainees  on  training  progress 

-  Develop  or  procure  training  materials  or  aids 
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Independent  Jobs 


Information  Warfare  (IW)  IJ  (N=6) 

-  Identify  counterintelligence  potentials  for  integration  into 
information  warfare  (IW)  plans 

-  Brief  customers  on  Electronic  Systems  Security 
Assessment  (ESSA)  disclosures 

-  Recommend  countermeasures  to  customers 


Management  and  Supervisory  IJ  (N=13) 

-  Evaluate  personnel  for  compliance  with  performance 
standards 

-  Determine  or  establish  work  assignments  or  priorities 

-  Establish  performance  standards  for  subordinates 


1N6X1 


14 


Independent  Jobs 


Mission  Management  IJ  (N=5) 

-  Schedule  mission  timeframes 

-  Store  classified  materials 

-  Coordinate  monitoring  requirements  with  consumers 


3% 


General  Administration  IJ  (N=3) 

-  Develop  or  maintain  continuity  books 

-  Initiate  requests  for  temporary  duty  (TDY)  orders 

-  Maintain  administrative  files 

-  Maintain  or  update  status  indicators,  such  as  boards, 
graphs,  or  charts 


2% 


1N6X1 


15 


Independent  Jobs 


Computer  Network  Defense  IJ  (N=4) 

-  Analyze  real-time  computer  events 

-  Analyze  computer  network  traffic  using  Ethereal 

-  Research  vulnerabilities,  exploits,  hacking  tools, 
malicious  logic,  computer  configurations,  patches,  or 
service  packs 

-  Analyze  exploit  codes 


1N6X1 
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Career  Ladder  Progression 


•  3-  and  5-skill-level  personnel 

-  Work  in  the  most  technical  jobs  in  the  career  field 

-  Spend  most  of  their  time  on  technical  tasks 

•  7-  and  9-skill-level  personnel 

-  Continue  to  perform  technical  tasks 

-  However,  take  on  supervisory,  training,  and 
administrative  duties 


1N6X1 
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w 

V 


Percent  Across  Specialty  Jobs 

DAFSC 


DUTY  AREAS 

DAFSC 

1N631 

(N=53) 

DAFSC 

1N651 

(N=88) 

DAFSC 

1N671 

(N=38) 

DAFSC 

1N691 

(N=5) 

Junior  Analyst  Cluster 

58 

19 

0 

0 

Senior  Analyst  IJ 

28 

56 

45 

20 

Training  IJ 

4 

7 

3 

0 

Information  Warfare  (IW)  IJ 

2 

0 

13 

0 

Management  and  Supervisory  IJ 

0 

2 

21 

60 

Mission  Management  IJ 

0 

3 

5 

0 

General  Administration  IJ 

1 

2 

0 

0 

Computer  Network  Defense  IJ 

0 

3 

3 

0 

Not  Grouped 

6 

8 

10 

20 

Indicates  less  than  1% 
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4  j  Career  Ladder  Progression 
Percent  Time  Spent  on  Duties 


DUTY  AREAS 

DAFSC 

1N631 

(N=53) 

DAFSC 

1N651 

(N=88) 

Performing  General  Electronic  System  Security 
Assessment  (ESSA)  Activities 

11 

13 

Performing  Telecommunications  Monitoring  and 
Assessment  Program  (TMAP)  Activities 

45 

27 

Performing  Friendly  Communications  Analysis 
Activities 

12 

8 

Performing  Operations  Reporting  Activities 

7 

13 

Performing  Computer  Network  Defense 

Activities 

2 

4 

Performing  Information  Warfare  (IW)  Activities 

7 

5 

Performing  General  Administrative  Activities 

5 

6 

Performing  General  Supply  and  Equipment 
Activities 

2 

3 

Performing  Training  Activities 

8 

10 

Performing  Management  and  Supervisory 

Activities 

1 

11 

*  Indicates  less  than  1% 


DAFSC  DAFSC 

1N671  1N691 

(N=38)  (N=5) 


9  4 

12  8 

6  2 

8  3 

3  1 


11 

7 

2 


17 

9 

1 


11 

31 


8 

47 
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\  J  First-Enlistment  Job  Structure 


Sample  size:  86 


Junior  Analyst 
Cluster 

46% 


Not  Grouped 
7% 


Senior  Analyst 
IJ 

37% 


Training  IJ 
5% 


Computer  Network 
Defense  IJ 

1% 


General 
Administration  IJ 

2% 


Mission 

Management 

IJ 

1% 


Information 
Warfare  IJ 

1% 
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First-Enlistment  Personnel 
Representative  Tasks 


Percent 

Members 

Performing 


Tasks _ (N=86) 

Analyze  telephone  communications  91 

Analyze  electronic  mail  (e-mail)  communications  90 

Research  open  source  information  80 

Identify  personal  privacy  information  (PPI)  78 

Create  or  develop  sanitized  transcripts  70 

Perform  data  transfers  66 

Identify  intelligence  threats  and  vulnerabilities  65 

Identify  OPSEC  vulnerabilities  64 

Destroy  classified  materials  62 

Create  or  develop  unsanitized  transcripts  60 

Perform  time  conversions  57 

Set  up  or  tear  down  telephone  monitoring  equipment  55 

Apply  classification  markings  to  classified  materials  55 

Correlate  critical  information  53 

Create  or  develop  summaries  of  collected  communications  52 
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First-Enlistment  Personnel 
Tools  &  Equipment 


Percent 

Members 

Performing 


Equipment _ (N=86) 

Headphones  86 

Sensor  Snare  Systems  73 

Collection  Units  70 

Personal  Computers  (PCs)  70 

Sensor  Empire  Systems  66 

Archival  Units  52 

Processing  Units  50 

Maps  33 

Removable  Map  Drives  31 

UNIX  Systems  30 
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Specialty  Training  Standard 

(STS)  Analysis 


•  STS  is  generally  supported  by  survey  data 

-  Seven  STS  items  were  unsupported 

•  Some  STS  items  may  need  proficiency  code 
review 

-  Seven  uncoded  STS  items  matched  to  Jl  tasks 
performed  by  more  than  20  percent  of  members 

•  Many  technical  tasks  performed  by  20  percent  or 
more  of  members  were  not  referenced  to  STS 

-  These  should  be  reviewed  for  possible  inclusion  in  STS 


1N6X1 
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Unsupported  STS  Elements 


Examples 

Percent 

Members 

Performing 


Prof  1st  1st  Tng  Tsk 

Unit  Learning  Objective  Code  Job  Enl  Emp  Dif  ATI 


5.1.1. 

Use  UNIX/UNIX  variants 

2b 

Task 

E0084.  Perform  UNIX  and  Windows 
systems  administration  procedures 

3 

7 

.88 

6.39 

2 

5.2.2 

Use  operational  databases 

2b 

Task 

E0086.  Query  databases  and  extract 
information  to  meet  mission 
requirements 

3 

3 

1.67 

6.08 

2 

10.6.3 

Identify  information  meeting  fraud, 
waste,  and  abuse  (FWA)  reporting 
guidelines 

2b 

Task 

B0027.  Process  fraud,  waste,  and 
abuse  (FWA)  reports 

13 

14 

2.33 

4.87 

7 

Mean  TE  Rating  is  1.80,  Standard  Deviation  is  2.07  (HIGH  TE=  3.87) 
Mean  TD  Rating  is  5.00,  Standard  Deviation  is  1.00  (HIGH  TD=  6.00) 
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Proficiency  Codes 
Requiring  Review 


Percent 

Members 

Performing 


Unit 

Learning  Objective 

Prof 

Code 

1st 

Job 

1st 

Enl 

Tng 

Emp 

Tsk 

Dif 

ATI 

1.3 

Classified  destruction 

A 

Task 

A0002.  Destroy  classified 
materials 

47 

62 

4.50 

2.05 

13 

11.2 

Task 

Intelligence  threat  and  vulnerability  to 
C4  systems 

C0039.  Identify  intelligence  threats 
and  vulnerabilities 

A 

66 

65 

4.25 

5.59 

18 

8. 6. 5. 2 
Task 

Operations  Security  (OPSEC) 

FI 01.  Identify  OPSEC  indicators 

B 

34 

51 

5.79 

4.61 

18 

Mean  TE  Rating  is  1.80,  Standard  Deviation  is  2.07  (HIGH  TE=  3.87) 
Mean  TD  Rating  is  5.00,  Standard  Deviation  is  1.00  (HIGH  TD=  6.00) 
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Tasks  not  Referenced  to  STS 


Examples 


Percent 

Members 

Performing 


Tasks 

1st 

Job 

1st 

Enl 

Tng 

Emp 

Tsk 

Dif 

ATI 

B0010 

Acquire  targeted  Cl  lists 

42 

50 

4.04 

4.17 

18 

B0019 

Create  or  develop  sanitized 
transcripts 

66 

70 

7.08 

4.07 

18 

B0021 

Create  or  develop  unsanitized 
transcripts 

50 

60 

7.08 

4.05 

18 

B0035 

Set  up  or  tear  down  e-mail 

29 

51 

6.88 

4.64 

18 

monitoring  equipment 


Mean  TE  Rating  is  1.80,  Standard  Deviation  is  2.07  (HIGH  TE=  3.87) 
Mean  TD  Rating  is  5.00,  Standard  Deviation  is  1.00  (HIGH  TD=  6.00) 
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Job  Satisfaction  Indicators  (AD) 
(Across  Specialty  Jobs) 


Junior 

Senior 

Information 

Analyst 

Analyst 

Training 

Warfare 

Cluster 

IJ 

IJ 

IJ 

(N=48) 

(N=82) 

(N=9) 

(N=6) 

Job  interesting 

46 

80 

100 

83 

Talents  well  utilized 

50 

80 

100 

83 

Training  well  utilized 

75 

89 

33 

67 

Sense  of 

accomplishment 

60 

73 

100 

83 

Plan  to  reenlist 

68 

94 

0 

83 
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Job  Satisfaction  Indicators  (AD) 
(Across  Specialty  Jobs  cont.) 


Mgt/Supy 

IJ 

(N=13) 

Mission 

Mangement 

IJ 

(N=5) 

General 

Admin 

IJ 

(N=3) 

Job  interesting 

92 

60 

66 

Talents  well  utilized 

92 

100 

67 

Training  well  utilized 

85 

60 

100 

Sense  of 
accomplishment 

100 

40 

67 

Plan  to  reenlist 

46 

40 

67 

Computer 
Network 
Defense  IJ 
(N=4) 

100 


100 


100 


100 


75 
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Retention  Dimensions 

First-Term  Airmen  (N=86) 


Planning  to  Reenlist  (N=59) 

Percent 

Responding 

Average 

Military  lifestyle 

80 

2.47 

Pay  and  allowances 

75 

2.39 

Job  security 

71 

2.55 

Medical  or  dental  care  for  AD  members 

66 

2.54 

Military-related  education/training  opportunities 

66 

2.26 

Planning  to  Separate  (N=24) 

Military  lifestyle 

46 

2.55 

Civilian  job  opportunities 

37 

1.89 

Esprit  de  corps/morale 

29 

2.43 

Work  schedule 

29 

2.14 

Location  of  present  assignment 

29 

2.00 

Scale:  1  =  slight  influence,  2  =  moderate  influence,  3  =  strong  influence 
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Retention  Dimensions 

Second-Term  Airmen  (N=35) 


Planning  to  Reenlist  (N=22) 

Percent 

Responding 

Average 

Retirement  benefits 

82 

2.67 

Job  security 

82 

2.33 

Pay  and  allowances 

73 

2.56 

Medical  or  dental  care  for  AD  members 

73 

2.50 

Bonus  or  special  pay 

68 

2.33 

Planning  to  Separate  (N=13) 

Military  lifestyle 

77 

2.20 

Location  of  present  assignment 

46 

2.33 

Recognition  of  efforts 

38 

2.00 

Pay  and  allowances 

38 

1.60 

Civilian  job  opportunities 

31 

2.75 

1N6X1 


Scale:  1  =  slight  influence,  2  =  moderate  influence,  3  =  strong  influence 
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Retention  Dimensions 

Career  Airmen  (N=51) 


Planning  to  Reenlist  (N=34) 

Percent 

Responding 

Average 

Job  security 

71 

2.29 

Retirement  benefits 

68 

2.83 

Medical  or  dental  care  for  family  members 

65 

2.41 

Military  lifestyle 

59 

2.45 

Medical  or  dental  care  for  AD  members 

59 

2.35 

Planning  to  Separate  (N=5) 

Civilian  job  opportunities 

80 

2.75 

Pay  and  allowances 

60 

2.33 

Leadership  at  unit  level 

40 

3.00 

Esprit  de  corps/morale 

40 

2.50 

Recognition  of  efforts 

40 

2.50 

Scale:  1  =  slight  influence,  2  =  moderate  influence,  3  =  strong  influence 
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Summary  of  Results 


•  Career  ladder  progression  typical 

-  Highly  technical  at  3-skill  level  progressing  to  more 
managerial  at  7-skill  level  and  beyond 

•  Career  ladder  documents  supported  by  survey 
data 

-  STS  provides  comprehensive  coverage  of  work 
performed  by  career  ladder 

-  Review  of  some  items  warranted 

•  Job  satisfaction  indicators 

-  Lower  expressed  job  interest  for  Junior  Analyst  Cluster 
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Way  Ahead 


•  OSR  Delivery  Trip  -  Jan  05 

•  Utilization  and  Training  Workshop  (U&TW)  -  TBD 
•  Scheduled  at  AIA 

•  Next  SKT  rewrite  (Ext  Minor)  -  scheduled  for  Aug  05 
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Questions? 


Visit  our  web  site  at: 

https://www-r.omsq.af.mil/OA/oaproducts.htm 


AFOMS/OA 

1 550  Fifth  Street  East 
Randolph  AFB,  TX  78150 

DSN  487-5030  Ext  XXXX 


E-Mail:  Mary.Hrynyk@randolph.af.mil 


Integrity  -  Service  -  Excellence 


Sustaining  the  Combat  Capability  of  America’s  Air  Force 


Integrity  -  Service  -  Excellence 


